63 results found.
Multilingual Task-Oriented Dialog Data-Basque
Written
Corpus,
Language Type:
Monolingual
Languages:
Basque
Availability:
Freely Available
License:
CC-BY-SA
Size:
6404 sentences Production Status:
Newly created-finished
Use:
Dialogue
-
Paper title:Building a Task-oriented Dialog System for Languages with no Training Data: the Case for Basque
-
Paper track:Written/oral presentation
-
Paper status:Accept Oral
| Author Number | Name | Affiliation | Country |
|---|---|---|---|
| Main Contact | Xabier Saralegi | Multilingual Task-Oriented Dialog Data-Basque | /N |
Documentation:
None
the open parallel corpus (OPUS)
Written
Corpus,
Language Type:
Multilingual
Languages:
Afrikaans Albanian Amharic Arabic Aragonese Armenian Assamese Azerbaijani Basque Belarusian Bengali Bosnian Breton Bulgarian Burmese Catalan Central Khmer Chinese Croatian Czech Danish Dutch Dzongkha English Esperanto Estonian Finnish French Gaelic Galician Georgian German Greek Gujarati Hausa Hebrew Hindi Hungarian Icelandic Igbo Indonesian Irish Italian Japanese Kannada Kazakh Kinyarwanda Korean Kurdish Kyrgyz Latvian Limburgan Lithuanian Macedonian Malagasy Malay Malayalam Maltese Marathi Mongolian Nepali Northern Sami Norwegian Norwegian Bokmål Norwegian Nynorsk Occitan Oriya Panjabi Pashto Persian Polish Portuguese Romanian Russian Serbian Serbo-Croatian Sinhala Slovak Slovenian Spanish Swedish Tajik Tamil Tatar Telugu Thai Turkish Turkmen Uighur Ukrainian Urdu Uzbek Vietnamese Walloon Welsh Western Frisian Xhosa Yiddish Yoruba Zulu
Availability:
Freely Available
License:
Size:
55 million sentences Production Status:
Existing-used
Use:
Machine Translation, SpeechToSpeech Translation
-
Paper title:Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translation
-
Paper track:Long/Machine Translation
-
Paper status:Accept
| Author Number | Name | Affiliation | Country |
|---|---|---|---|
| Main Contact | Biao Zhang | the open parallel corpus (OPUS) | /N |
Documentation:
None
Elmo For Many Languages
Not Applicable
Contextualsed word embeddings,
Language Type:
Monolingual
Languages:
Ancient Arabic Basque Bokmål Bulgarian Catalan Chinese Church Croatian Czech Danish Dutch English Estonian Finnish French Galician German Greek Hebrew Hindi Hungarian Indonesian Irish Italian Japanese Korean Latin Latvian Norwegian Nynorsk Old Persian Polish Portuguese Romanian Russian Simplified Chinese Slavonic Slovak Slovene Spanish Swedish Turkish Ukrainian Urdu Uyghur Vietnamese
Availability:
Freely Available
License:
none
Size:
18.4 GByte Production Status:
Existing-used
Use:
Parsing and Tagging
-
Paper title:Treebank Embedding Vectors for Out-of-domain Dependency Parsing
-
Paper track:Short/Syntax: Tagging, Chunking and Parsing
-
Paper status:Accept
| Author Number | Name | Affiliation | Country |
|---|---|---|---|
| Main Contact | Joachim Wagner | Elmo For Many Languages | /N |
Documentation:
https://www.aclweb.org/anthology/K18-2005/
SAVAS META-SHARE repository
Speech/Written
Corpus,
Language Type:
Multilingual
Languages:
Basque French German Italian Portuguese Spanish
Availability:
From Data Center(s)
License:
META-SHARE and/or CC
Size:
1040 hours Production Status:
Newly created-in progress
Use:
Speech Recognition/Understanding
-
Paper title:Recognition of Latin American Spanish using Multi-task Learning
-
Paper track:8.12 Cross-lingual and multilingual/accent aspects/Poster Presentation
-
Paper status:Accept - Poster
| Author Number | Name | Affiliation | Country |
|---|---|---|---|
| Main Contact | Carlos Mendes | SAVAS META-SHARE repository | /N |
Documentation:
None
COST278 database
Speech/Written
Corpus,
Language Type:
Multilingual
Languages:
Basque Belgian Dutch Croatian Czech Galician Greek Hungarian Portuguese Slovak Slovenian Spanish
Availability:
From Owner
License:
Size:
None Production Status:
Existing-used
Use:
Evaluation/Validation
-
Paper title:An Approach to Online Speaker Change Point Detection Using DNNs and WFSTs
-
Paper track:5.4 Speech and audio segmentation/Poster Presentation
-
Paper status:Accept - Poster
| Author Number | Name | Affiliation | Country |
|---|---|---|---|
| Main Contact | Lukas Mateju | COST278 database | /N |
Documentation:
None
UniSent
Written
Lexicon,
Language Type:
Multilingual
Languages:
'Auhelawa Abau Aceh Achang Acholi Achuar-Shiwiar Aché Adamawa Fulfulde Adele Adhola Adi Adioukrou Aekyom Afrikaans Agarabi Aguacateco Aguaruna Agusan Manobo Agutaynen Aimol Ajië Ajyíninka Apurucayali Akawaio Akeu Akha Akoose Alamblak Alangan Alekano Algonquin Alladian Alune Alur Ama Amanab Amarakaeri Amarasi Ambai Ambulas Amele Amganad Ifugao Amharic Amri Ancient Greek Aneme Wake Angaatiha Angal Heneng Angami Naga Angor Anjam Anufo Ao Naga Apalaí Apatani Apinayé Apurinã Arabela Arifama-Miniafia Armenian Arop-Lukep Arosi Aruamu Asháninka Ashéninka Pajonal Assyrian Neo-Aramaic Ata Manobo Atatláhuca Mixtec Au Aukan Avar Avokaya Awa Awa-Cuaiquer Awadhi Awiyaana Ayoreo Ayutla Mixtec Azerbaijani Baatonum Baba Malay Bafia Bafut Bahasa Melayu Baka Bakairí Balangao Balantak Bali Bamanankan Bana Bandial Banggai Baoulé Barai Barasana Bargam Bariai Baruya Bashkir Basque Bassari Batad Ifugao Batak Angkola Batak Dairi Batak Karo Batak Simalungun Batak Toba Bauzi Bavarian Bawm Chin Bedjond Beembe Bekwarra Belarusan Belize Kriol English Bemba Bembe Benabena Bengali Berom Bete-Bendi Biangai Biatah Biete Bima Bimin Bimoba Bine Binukid Binumarien Bislama Bissa Bisu Bokmal Norwegian Boko Bokobaru Bola Bomu Bora Border Kuna Borong Bribri Buamu Bugawac Bugis Buhid Bukiyip Bulgarian Buli Bulu Bumbita Arapesh Bunama Burarra Burmese Burum-Mindik Busa Cabécar Cacua Caluyanun Cameroon Mambila Camsá Candoshi-Shapra Capanahua Caquinte Car Nicobarese Carapana Carib Caribbean Hindustani Caribbean Javanese Carrier Cashibo-Cacataibo Cashinahua Casiguran Dumagat Agta Catalan-Valencian-Balear Cavineña Cebuano Central Aymara Central Bicolano Central Bontok Central Cagayan Agta Central Cakchiquel Central Dusun Central Huasteca Nahuatl Central Khmer Central Kurdish Central Mnong Central Yupik Central-Eastern Niger Fulfulde Cerma Chachi Chamacoco Chamorro Chang Naga Chavacano Chayahuita Chayuco Mixtec Chechen Cherokee Chhattisgarhi Chipaya Chiquihuitlán Mazatec Chiquitano Chiripá Chopi Chortí Chothe Naga Chuave Chumburung Chuukese Chuvash Chácobo Cishingini Coatlán Mixe Coatzospan Mixtec Cofán Cogui Colorado Comaltepec Chinantec Coptic Cornish Cotabato Manobo Croatian Cubeo Cuiba Culina Czech Dadibi Daga Dan Dangaléat Danish Dano Dawawa Dawro Dedua Deg Denya Desano Dhao Dibabawon Manobo Digo Dii Dimasa Djambarrpuyngu Djimini Senoufo Dobu Dogrib Doyayo Dupaninan Agta Duri Duruma Dutch East Kewa Eastern Bolivian Guaraní Eastern Bontok Eastern Bru Eastern Canadian Inuktitut Eastern Highland Chatino Eastern Huasteca Nahuatl Eastern Jacalteco Eastern Kanjobal Eastern Krahn Eastern Mari Eastern Oromo Eastern Tawbuid Efik Ejagham Ekajuk El Nayar Cora Endo English Enxet Erzya Ese Ese Ejja Esperanto Estonian Ewage-Notu Ezaa Faiwol Falam Chin Farefare Faroese Fasu Fijian Fijian Hindustani Filipino Finnish Fon Fore French Ga Ga'dang Gagauz Galela Galo Adi Gamo Ganda Gangte Garifuna Garo Gbagyi Gen Georgian Gheg Albanian Ghomálá' Gidar Gikuyu Gikyode Girawa Gofa Gogo Gokana Golin Gonja Gor Gorontalo Gourmanchéma Greek Guahibo Guajajára Guambiano Guanano Guarayu Guayabero Gude Guerrero Amuzgo Guerrero Nahuatl Guhu-Samane Guinea Kpelle Gujarati Gulay Gumatj Gumuz Gun Gusii Gwahatike Gwich'in Haitian Creole French Haka Chin Hakka Chinese Halh Mongolian Halia Hamer-Banna Hanga Hanunoo Hausa Hawai'i Creole English Haya Hebrew Hehe Helong Highland Oaxaca Chontal Highland Puebla Nahuatl Hiligaynon Hindi Hiri Motu Hixkaryána Hmong Daw Hmong Njua Hopi Hote Hrangkhol Huambisa Huautla Mazatec Huichol Huli Hungarian Iatmul Iban Ibatan Icelandic Igbo Ignaciano Ika Ikwere Ikwo Ilianen Manobo Ilocano Imbongu Inabaknon Indonesian Inga Inoke-Yate Iraqw Iraya Iriga Bicolano Irigwe Irish Gaelic Islander Creole English Isnag Isthmus Mixe Isthmus-Mecayapan Nahuatl Italian Itawit Iu Mien Ivatan Ivbie North-Okpela-Arhe Iwal Iyo Iyo'wujwa Chorote Iyojwa'ja Chorote Izere Izii Jalapa de Díaz Mazatec Jamaican Creole English Jamiltepec Mixtec Japanese Jarai Javanese Jingpho Jola-Fonyi Jola-Kasa Jukun Takum Jula Juquila Mixe Jur Modo Kabiyé Kabyle Kadiwéu Kafa Kagayanen Kagulu Kahua Kaingáng Kaiwá Kako Kalagan Kalam Kalanga Kamano Kamasau Kambaata Kamwe Kandawo Kanite Kankanaey Kannada Kapingamarangi Kara Karachay-Balkar Karajá Karakalpak Karamojong Karbi Kasua Kayabí Kazakh Keapara Kein Kekchí Kele Keley-I Kallahan Kenga Kenyang Keyagana Khakas Khiamniungan Naga Kim Kimré Kinaray-A Kire Kirghiz Kiribati Kisar Kituba Kobon Kom Komba Komi-Zyrian Komso Konai Konni Kono Konyak Naga Koongo Koorete Korafe Korean Koreguaje Koronadal Blaan Kosena Kouya Koya Krio Kuanua Kube Kukele Kuku-Yalanji Kumam Kuman Kumyk Kunimaipa Kuot Kupang Malay Kupsabiny Kuranko Kusaal Kutep Kutu Kuwaa Kuwaataay Kwaio Kwanga Kwanyama Kwara'ae Kwere Kwoma Kyaka Laari Lacandon Ladakhi Lahu Lahu Shi Lalana Chinantec Lama Lamba Lambya Lamkang Lampung Lango Lao Lashi Latin Latvian Lealao Chinantec Ledo Kaili Lega-Mwenga Lelemi Lengua Lenje Lewo Lhomi Liangmai Naga Limbu Limbum Limos Kalinga Lingala Literary Chinese Lithuanian Lobi Loma Low Saxon Lozi Luang Lukpa Luo Luwo Lyélé Ma'anyan Ma'di Maasina Fulfulde Mabaan Maca Macedonian Machame Machiguenga Macuna Macushi Mada Madak Madura Mafa Maithili Maiwa Makaa Makasar Makonde Malayalam Malba Birifor Male Maltese Mamanwa Mamara Senoufo Mamasa Mampruli Manam Mandinka Mangga Buang Manggarai Mangseng Manikion Mankanya Mansaka Maori Mape Mapos Buang Mapudungun Maram Naga Maranao Marathi Marba Marik Maring Naga Marshallese Maru Masaba Masana Masbatenyo Maskelynes Matal Matigsalug Manobo Matsés Mauwake Maxakalí Mayo Mayoyao Ifugao Mazahua Central Mazatlán Mixe Mbay Mbo-Ung Mbuko Mbula Mbunda Mbyá Guaraní Mekeo Melpa Mende Mengen Mentawai Merey Meyah Mian Michoacán Nahuatl Micmac Middle English Min Nan Chinese Minangkabau Minaveha Minica Huitoto Mizo Moba Mocoví Mofu-Gudur Mokole Molima Mong Leng Mong Njua Mongo-Nkundu Mongondow Mono Moose Cree Mopán Maya Morisyen Moro Moskona Motu Mountain Koiali Moyon Naga Mufian Muinane Mumuye Muna Mundang Mundani Mundurukú Murle Murui Huitoto Musey Muyang Mískito Mòoré Mün Chin Mündü Naasioi Nabak Nadëb Nafaanra Nakanai Nalca Nama Nande Nandi Naro Navajo Nawdm Ndamba Ndau Ndebele Ndo Ndogo Ndonga Nepali Nga La Ngaju Ngangam Ngawn Chin Ngiemboon Ngindo Ngiti Ngombe Ngulu Ngäbere Nias Nigeria Mambila Nigerian Fulfulde Nii Nilamba Ninzo Nivaclé Nkonya Nobonob Nocte Naga Nogai Nomaande Nomatsiguenga Noone Nopala Chatino North Alaskan Inupiatun North Mofu Northeastern Dinka Northern Dagara Northern Emberá Northern Grebo Northern Khmer Northern Kissi Northern Kurdish Northern Mam Northern Oaxaca Nahuatl Northern Puebla Nahuatl Northwest Alaska Inupiatun Northwest Gbaya Ntcham Numanggang Nyindrou Nyishi Nynorsk Norwegian Obolo Ocotepec Mixtec Ogea Old Church Slavonic Olusamia Ozumacín Chinantec Palantla Chinantec Pamplona Atta Paraguayan Guarani Patpatar Pele-Ata Peñoles Mixtec Phom Naga Pichis Ashéninka Pinotepa Nacional Mixtec Plapo Krumen Psikye Pular Qaqet Quiotepec Chinantec Rabinal Achí Russia Buriat Rwanda S'gaw Karen Sa'a Saamia Sabu Safeyoka Saint Lucian Creole French Samba Leko San Blas Kuna San Jerónimo Tecóatl Mazatec San Juan Colorado Mixtec San Juan Cotzal Ixil San Mateo del Mar Huave San Miguel el Grande Mixtec San Pedro Amuzgos Amuzgo San Sebastián Coatán Chuj Santa María Zacatepec Mixtec Santa Teresa Cora Sar Sarangani Blaan Sarangani Manobo Sateré-Mawé Sea Island Creole English Sekpele Sepik Iwam Seselwa Creole French Sharanahua Shuar Silacayoapan Mixtec Siyin Chin Sochiapan Chinantec South Fali South Giziga Southern Altai Southern Birifor Southern Bobo Madaré Southern Carrier Southern Ghale Southern Kalinga Southern Kisi Southern Nambikuára Southern Nuni Southern Puebla Mixtec Southwest Gbaya Southwestern Dinka Standard Arabic Standard German Tabasco Chontal Tabo Tagabawa Takuu Tangkhul Naga Tataltepec Chatino Tedim Chin Tenango Nahuatl Tepetotutla Chinantec Tepeuxila Cuicatec Tetelcingo Nahuatl Teutila Cuicatec Tezoatlán Mixtec Tlahuitoltepec Mixe Tol Toro So Dogon Totontepec Mixe Toura Tsikimba Tsimané Tuma-Irumu Tumbalá Chol Tungag Tuwali Ifugao Uab Meto Ucayali-Yurúa Ashéninka Umanakaina Umiray Dumaget Agta Una Usila Chinantec Vengo Veracruz Huastec Waimaha Wancho Naga Wandala Waorani Wayuu Welsh West Kewa West-Central Limba Western Apache Western Arrarnta Western Bolivian Guaraní Western Bukidnon Manobo Western Frisian Western Highland Chatino Western Huasteca Nahuatl Western Kanjobal Western Niger Fulfulde Wichí Lhamtés Güisnay Wichí Lhamtés Nocten Wipi Woun Meu Xaasongaxango Yabem Yanesha' Yocoboué Dida Yosondúa Mixtec Zaiwa Zarma Zemba Zotung Chin Zulgo-Gemzek Éwé Ömie
Availability:
Freely Available
License:
CC BY-NC-ND license (Attribution-NonCommercial-NoDerivs)
Size:
7 MByte Production Status:
Newly created-finished
Use:
Opinion Mining/Sentiment Analysis
-
Paper title:UniSent: Universal Adaptable Sentiment Lexica for 1000+ Languages
-
Paper track:Terminology/poster presentation
-
Paper status:Accept Poster
| Author Number | Name | Affiliation | Country |
|---|---|---|---|
| Main Contact | Ehsaneddin Asgari | UniSent | /N |
Documentation:
None
MaSS dataset
Speech/Written
Corpus,
Language Type:
Multilingual
Languages:
Basque English Finnish French Hungarian Romanian
Availability:
Freely Available
License:
MIT License
Size:
8130 sentences Production Status:
Newly created-finished
Use:
Machine Translation, SpeechToSpeech Translation
-
Paper title:MaSS: A Large and Clean Multilingual Corpus of Sentence-aligned Spoken Utterances Extracted from the Bible
-
Paper track:Speech/oral presentation
-
Paper status:Accept Poster
| Author Number | Name | Affiliation | Country |
|---|---|---|---|
| Main Contact | Marcely Zanon Boito | MaSS dataset | /N |
Documentation:
Documentation in English at the github page
Universal Dependencies 1.2
Written
Corpus,
Language Type:
Multilingual
Languages:
Ancient Greek Basque Croatian Standard Arabic
Availability:
Freely Available
License:
CC BY 4.0, CC BY-SA 3.0, CC BY-SA 4.0, CC BY-NC-SA 2.5, CC BY-NC-SA 3.0 US, CC BY-NC-SA 3.0, CC BY-NC-SA 4.0, GNU GPL 2.0, GNU GPL 3.0
Size:
7529911 words Production Status:
Existing-used
Use:
Parsing and Tagging
-
Paper title:UDPipe: Trainable Pipeline for Processing CoNLL-U Files Performing Tokenization, Morphological Analysis, POS Tagging and Parsing
-
Paper track:Written
-
Paper status:Accept Poster+Demo
| Author Number | Name | Affiliation | Country | ||
|---|---|---|---|---|---|
| Author 1 | Milan Straka | Charles University in Prague | None | Charles University | None |
| Author 2 | Jan Hajic | Charles University in Prague | CZ | ||
| Author 3 | Jana Straková | Charles University in Prague, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics | CZ | ||
| Main Contact | Milan Straka | Charles University in Prague | None | Charles University | None |
Documentation:
http://universaldependencies.org/
Universal Dependencies
Written
Treebank,
Language Type:
Multilingual
Languages:
Basque Bulgarian Croatian Standard Arabic
Availability:
Freely Available
License:
Various licenses but mostly CreativeCommons
Size:
250 000 sentences Production Status:
Newly created-in progress
Use:
Parsing and Tagging
-
Paper title:Universal Dependencies v1: A Multilingual Treebank Collection
-
Paper track:Written
-
Paper status:Accept Oral
| Author Number | Name | Affiliation | Country |
|---|---|---|---|
| Author 1 | Joakim Nivre | Uppsala University | SE |
| Author 10 | Natalia Silveira | Stanford University | US |
| Author 11 | Reut Tsarfaty | Open University of Israel | IL |
| Author 12 | Daniel Zeman | Charles University in Prague, Faculty of Mathematics and Physics | CZ |
| Author 2 | Marie-Catherine de Marneffe | The Ohio State University | US |
| Author 3 | Filip Ginter | University of Turku | FI |
| Author 4 | Yoav Goldberg | Bar Ilan University | IL |
| Author 5 | Jan Hajic | Charles University in Prague | CZ |
| Author 6 | Christopher D. Manning | Stanford University | US |
| Author 7 | Ryan McDonald | US | |
| Author 8 | Slav Petrov | US | |
| Author 9 | Sampo Pyysalo | University of Cambridge | GB |
| Main Contact | Joakim Nivre | Uppsala University | None |
Documentation:
Documentation is available in English on the website
Speaking Atlas of the Regional Languages of France
Speech/Written
Corpus,
Language Type:
Multilingual
Languages:
Basque Breton Corsican Frankish
Availability:
Freely Available
License:
<Not Specified>
Size:
2 hours Production Status:
Newly created-finished
Use:
Language documentation
-
Paper title:A Speaking Atlas of the Regional Languages of France
-
Paper track:Speech
-
Paper status:Accept Poster+DemoSuggested
| Author Number | Name | Affiliation | Country |
|---|---|---|---|
| Author 1 | Philippe Boula de Mareüil | LIMSI-CNRS | FR |
| Author 2 | Albert Rilliard | LIMSI-CNRS | FR |
| Author 3 | Frédéric Vernier | LIMSI-CNRS | FR |
| Main Contact | Philippe Boula de Mareüil | LIMSI-CNRS | None |
Documentation:
<Not Specified>